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Introduction. In all types of digital communication, error control coding techniques are used. Many digital 
communication standards, such as W1-Fi and 5G, use low density parity check (LDPC) codes. These codes are popular 
because they provide building encoders and decoders with low computational complexity. This work objective is to 
increase the error correcting capability of the well-known bit-flipping decoder (BF) of LDPC-codes. For this purpose, a 
modification of the decoder is built, which enables to dynamically control one of its main parameters whose choice 
affects significantly the quality of decoding. 

Materials and Methods. The well-known bit-flipping decoder of binary LDPC-codes is considered. This decoder has 
several parameters that are not rigidly bound with the code parameters. The dependence of the decoding quality on the 
selection of the output parameters of the bit-flipping decoder was investigated through simulation modeling. It is shown 
that the decoding results in this case are significantly affected by the input parameter of the decoder — threshold 7. A 
modification of the BF-decoder of binary LDPC-codes has been developed, in which it is proposed to set the threshold 
dynamically during the execution of the algorithm depending on the error rate. A comparative analysis of the error- 
correcting capability of decoders 1s carried out by the simulation modeling method. 

Results. A lemma on the maximum value of the decoder threshold T is formulated and proved. Upper bounds for the 
number of operations are found for the original and modified decoders. A simulation model that implements a digital 
noise-immune communication channel has been built. In the model, the initial data is encoded with a given LDPC-code, 
then it is made noisy by additive uniformly distributed errors, and thereafter, it is decoded in turn by the bit-flipping 
algorithm with different threshold T parameters, as well as by a modified decoder. Based on the input and output data, 
the correction capacity of the decoders used is estimated. Experiments have shown that the error-correcting capability of 
the modified decoder in the range of the real error rate is higher than that of the original decoder, regardless of the 
selection of its parameters. 

Discussion and Conclusions. The lemma, proved in the paper, sets the upper bound on the threshold value in the 
original decoder, which simplifies its adjustment. The developed modification of the decoder has a better error- 
correcting capability compared to the original decoder. Nevertheless, the complexity of the modification is slightly 
increased compared to the original algorithm. It has been pointed out that the decoding quality of a modified decoder 


develops with a decrease in the number of cycles in the Tanner graph and an increase in the length of the code. 
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Introduction. In 1963, in [1], R. Gallager first described a class of linear block codes whose check matrix 
contains a small number of nonzero elements. Such codes are commonly referred to as low-density parity check codes, 
or LDPC codes. For them, it is possible to build encoders and decoders with low computational complexity. Thus, when 
using LDPC codes, the data transfer rate is not significantly limited. Many modern studies are devoted to LDPC codes 
and their decoders [2-5]. LDPC codes are widely used in various digital communication standards, such as W1-F1, 5G, 
and optical communication [6, 7]. However, despite the popularity of these codes, some of the problems associated with 
them require research and solution. One of them is building new decoders and improving the existing ones. 

This work objective is to increase the error-correcting capability of the well-known bit-flipping decoder of 
LDPC codes (hereinafter referred to as the BF decoder). To do this, a modification of the decoder is built, which 
enables to dynamically control one of its key parameters, whose selection affects significantly the quality of decoding. 

Materials and Methods. The key parameters of binary LDPC codes are length N, dimension K and minimum 
code distance d. The information words [N, K, d] of the C-code are vectors m = (m,,mMj,..., Mx) € Fs , Where F, is the 
Galois field of cardinality 2, and the codewords are vectors € = (C1,Cp,...,Cy) € Fs’ [8]. It is convenient to set the 
LDPC codes with the check (N — K) X N matrix H. Most of its elements are zero [1], so it is more convenient to store 
it not entirely, but storing only the positions of nonzero elements rowwise. 

There are regular [9] and irregular [10] LDPC codes. In regular codes, all rows and columns of the check 
matrices contain a fixed number of single elements (k and j, respectively), otherwise the code is called irregular. For 
convenience, check matrices of regular LDPC codes will be called regular matrices, and irregular LDPC codes — 
irregular. 

Regular LDPC codes have a number of advantages: easily evaluated code parameters, easy storage of matrices, 
low computational complexity of encoding and decoding algorithms, etc. In addition, regular code decoders correct 
errors evenly, unlike irregular ones, which correct errors in some parts of the codeword worse than in others. However, 
the problem of generating regular matrices with given properties is complex, and brute-force methods are often used to 
solve it. 

To discuss the properties of the matrix H it is convenient to use the corresponding Tanner graph G = (V,E), 
where E — a set of edges, and V = SUR — a set of vertices, S — a set of rows of the matrix H, and R — a set of its 
columns [11]. Each nonzero element H, standing in the i-th row and the j-th column, defines an edge connecting the i- 
th vertex of the set S and the j-th vertex of the set R. Fig. 1 shows an example of a regular check matrix 3x6 with 


parameters k = 4 and j = 2, and the corresponding Tanner graph. 





Fig. 1. The cycle in Tanner graph and in the check matrix 


The top row of the graph vertices corresponds to the columns of the matrix H, and the bottom row is connected 
to the rows of H. An important characteristic of the check matrix H of the LDPC code 1s the presence and type of cycles 
in the corresponding Tanner graph. A cycle is a sequence of adjacent vertices of a graph in which the first and last 
vertices coincide. The length of this sequence is called the cycle length. The minimum cycle length in a graph is called 
the girth. If the graph contains no cycles, its girth is assumed to be infinite. An example of a cycle of length 4 is 
highlighted in bold lines in the graph (Fig. 1). 
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The error-correcting capabilities depend not only on the key parameters of the LDPC codes, but also on the 
structure of the check matrix H. On the one hand, the presence of cycles of small lengths (such as 4 and 6) impairs 
noticeably the error-correcting capability of the decoder [12]. On the other hand, the code that corresponds to Tanner 
graph without cycles does not correct errors, since its minimum code distance is 2. Thus, the task of constructing check 
matrices of regular LDPC codes is multiparametric. When solving it, you need to monitor the key parameters of the 
code, as well as the cycles in Tanner graph corresponding to the check matrix. 

Consider the well-known BF-decoder of the LDPC code C in a convenient form [13]. 

Input: LDPC code C with parameters [N, K,d], given by the check matrix 


hi hi ann hin 
Aw-k)1 Aw-Kj2 = Aw-Kw 
Vector ¢ =€+é@, CE C(c F’), @(€ Fs’) — error vector; p — the number of iterations of the algorithm; 7 — 


threshold value. 

Output: code vector € € C(c F¥). 

Step 1. Let the counter r be equal to zero. 

Step 2. Calculate the syndrome 5 = ¢’H’. If 5 = 0 orr = p, then go to step S. 

Step 3. Select the unit coordinates from the vector 5 = (s1, 59, ...,) Sy_x), L¢., S; = 1,i = 1,(N — K). Compose 
the set L = {ils; = 1}. Calculate h’ = (hj, h}, ..., hy), where 

hy = dier hu. (2) 

The values h,,, 1 = 1,..., N should be assumed to be nonnegative integers. Thus, h’ € NW’, where Ny = N U {0}. 

Step 4. In the vector h’ = (hj,hj,..., hy), we find all the elements h; > T. Among them, we select random h; 
and invert the bit c; of the vector c. Add a unit to the counter r and go to step 2. 

Step 5.c := Cc’. 

The research carried out in this work allows us to make some observations on the BF-decoder. 

Observation |. The input parameter p sets the maximum number of iterations of the algorithm from the 2nd to 
the 4th steps, but the decoder can recover the codeword in fewer iterations. 

Observation 2. When selecting the parameter T, the following considerations should be taken into account. If 
the parameter d of the used [N, K,d]|-code C is known, then it can be applied to calculate t — the number of reliably 


recoverable errors, and then the number of decoder iterations is limited to this value: 


p=t=|—. (3) 


2 
Here, |x] — rounding the number x to a smaller integer. If the parameter d is unknown, then it can be estimated using 


the Singleton bound [5] 
d<N-K+1 
and, using (3), we obtain 
N-K 
r= ES] 
Observation 3. The structure of the decoder is such that the recovery of the correct codeword is not guaranteed, 
even if in the noisy word c’ = € + €, no more than t errors occurred (3). 


Observation 4. In the literature, for regular check matrices in the BF decoder, it 1s recommended to select the 
threshold T depending on the weight j of the column of the matrix H, namely, T = - For irregular matrices, such 


recommendations are not given in the literature. The error-correcting capability of the BF decoder can be worsened by 
an unsuccessful selection of threshold T. If its value is large, at step 4 of the decoder, the vector h’ may not have a 
coordinate that exceeds the threshold T, therefore, the erroneous bits will not be corrected. If you select a small value of 
T in step 4 of the BF decoder, several coordinates, whose value exceeds the threshold, may appear in the vector h’. 
Among them, there may be coordinates that do not contain an error. Thus, the selection of the parameter 7 can 


significantly affect the decoding quality. 


Gurskiy S. S., et al. On the modification of bit-flipping decoder of LDPC-codes 





Research Results. We formulate and prove a lemma on the maximum possible value of the threshold T. Then 
we modify the BF decoder so that the threshold is set dynamically during the decoding process, and conduct a 
comparative analysis of the original and modified decoding algorithms. 

Lemma. Let the binary [N,K,d]|-code C be given by the check matrix H having a fixed number of 7 unit 
elements in each column. Then the maximum threshold value T for the BF decoder of such LDPC code C cannot be 
greater than 

fey a (4) 

Proof. Let the vector c’ = ¢ + € be obtained from the transmission channel, where c € C — is the correct 
codeword, @ € Fj’ — the error vector with the Hamming weight w(é). If w(é) = 0, then, in step 2, the vector- 
syndrome 5 = 0. Hence, the algorithm will go to step 5 and return é’ as the answer. In this case, the threshold value is 
not used. If w(é) > 0, then the regularity of H implies the validity of the inequality h; < j, where h;, — the elements of 
the vector h’. The inverting of the bit c, of the vector ¢’ occurs in the algorithm only if h; > T. Therefore, 

T<h, Sj. 

Thus, the formula (4) is correct. 

We will make changes to the BF decoder that will allow us to determine the threshold value dynamically, 
depending on the degree of damage to the code vector in the transmission channel. 

Input: [N, K, d]-code C given by the above check matrix (1). Vector ¢’ = € + &, where € € C(c FY), @ (€ F,) 
— the error vector; p — the number of iterations of the algorithm; T — some threshold value selected in advance. 

Output: code vector € € C(c FW’). 

Step 1. Let the counter r be equal to zero. 

Step 2. Calculate the syndrome 5 = ¢’H’. If 5 = (0,...,0) or r = p, then go to step 7. 

Step 3. Select the unit coordinates from the vector 5 = (s1, 59, ...,Sy_x), i-¢., S; = 1,i = 1,(N — K). Compose 
the set L = {ils; = 1}. Calculate h' = (hj,h},..., hy), where h; is the same as in the original decoder (2). When 
summing the value h,, | = 1,..., N, we should assume nonnegative integers. Thus, h’ € NX, rae N, = N u {0}. 

Step 4. Initialize the threshold value T = max(h;))<1..y — 1. 

Step 5. If T = 0 

Select an arbitrary element hj, 'of the vector h’ — such as hi, > T. 
Invert the bit cg. 

Step 6. Add a unit to the counter r and go to step 2. 

Step 7.¢ = Cc’. 

Observation 5. The modified algorithm generally performs fewer iterations than the BF decoder since the 
threshold is selected dynamically in step 4. Therefore, the decoder does not perform useless iterations that do not 
change the bits of the vector c’. The threshold value in the modified decoder depends on the number of errors that 
damaged the codeword, and is immediately set so that the noisy codeword c’ is guaranteed to be changed. 

Let us estimate from above the number of addition, comparison and assignment operations in both decoders. In 
the original BF decoder of the [N,K,d|-code C, p(kK +(N—K)N +1) addition operations, p(3N — 2K + 2) 
comparison operations and p((N —K)(k+1)+2N+ 3) + 1 assignment operations are performed. In the BF decoder 
with dynamic threshold, p(kK + (N — K)N +3) addition operations, p(SN — 2K + 3) comparison operations and 
p((N —K)(k+1)+2N+ 4) + 1 assignment operations are performed. Here, p — the decoder parameter that sets the 
maximum number of operations, k — weight of the code check matrix rows. Note that when implementing the 
algorithm, the multiplication and division operations are not actually used, as long as at the second step, it is convenient 
to use addition operations instead of multiplication to calculate the syndrome S. Recall that the matrix H has a sparse 
structure, and its rows are conveniently stored as a list of nonzero element numbers. Therefore, instead of multiplying 
the vector C’ by the matrix H, it is required to sum the coordinates of the vector C’, whose numbers coincide with the 


numbers of nonzero elements in the corresponding row of the matrix H. 
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Compared to the original algorithm, the modified BF decoder performs more operations, but moderately: the 
number of comparison operations has increased by p(2N + 1), assignment operations — by p, addition operations — 
by 2p. 

For a comparative study of the error-correcting capability of the original and modified decoding algorithms, a 
software tool has been created that implements a simulation model of a binary symmetric perfectly synchronized noise- 
immune communication channel according to [14-16]. To provide noise immunity, the model uses LDPC codes and BF 
decoders (original and with dynamic threshold). Errors in the channel were modeled as independent and uniformly 
distributed. 

The experiments used purposely found check matrices that specify LDPC codes. We describe the key 

parameters of these matrices using the standard notation of the key parameters of the code, as well as: j and k — the 
weight of each column and the weight of each row of the check matrix, respectively; w,,0, — 4 and 6 cycles in Tanner 
graph corresponding to the check matrix. 
Regular matrix H,;:N = 20,K =5,j =3,k =4,d =6,0, =0, 0, = 41. 
Regular matrix Hj: N = 28, K =7,j =3,k =4,d =6,w, = 0, W, = 42. 
Regular matrix H3:N = 28, K =7,j =3,k =4,d = 6,0, =0,W, = 29. 
Irregular matrix H,: N = 32, K =5,j =3,d=12,0, =0,0, = 0. 

Using these matrices, LDPC codes were constructed and simulation experiments were conducted. Fig. 2—5 
show graphs of the dependence of the error-correcting capability of the constructed LDPC codes on the error probability 
in the channel. For the rationale for selecting the threshold values T = 1 and T = 2 in the BF decoder, see Observations 


3, 4 and Lemma. 
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Fig. 2. Graph of the decoder error-correcting capability for LDPC codes given by the matrix H, 
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Fig. 3. Graph of the decoder error-correcting capability for LDPC codes given by the matrix H3 
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Fig. 4. Graph of the decoder error-correcting capability for LDPC codes given by the matrix H, 


Information technology, computer science, and management 


— 
) 
— 


http://vestnik-donstu.ru 


102 


Advanced Engineering Research 2021. V. 21, no. 1. P. 96-104. ISSN 2687-1653 





——— Decoder with dynamic threshold {fT 


i BF decoder with threshold T= 1 
BF decoder with threshold T = 2 


Error probability in the noise-immune channel 





oo00 0.005 o.010 0.015 0.070 2075 0.080 
Error probability in the channel without error-correcting coding 


Fig. 5. Graph of the decoder error-correcting capability for LDPC codes given by the matrix H, 


In the range of the real error level [8, 13, 14] in Fig. 2-4, it can be observed that the BF decoder at the 
threshold value T = 2 shows better results than at T = 1, and the modified BF decoder has a better error-correcting 
capability compared to the original one. 

The decoders show similar efficiency at small values of the code length, but when it is increased, the modified 
decoder shows better results. Specifically, if the error probability in the non-noise-immune channel is 0.05, the 
difference in the error probability in the noise-immune channel when using a BF decoder with the threshold T = 2 and 
T = 1, 1s from 0.005 to 0.03 in favor of using a larger threshold value. If a BF decoder with the threshold T = 2 and a 
modified decoder are used, this difference varies depending on the LDPC code in the range from 0.001 to 0.003. If the 
error probability in the non-noise-immune channel is 0.1, the error probability in the noise-immune channel when using 
a BF decoder with the threshold T = 2 is less than with the threshold T = 1 by the value from 0.001 to 0.02. When 
using a BF decoder with the threshold T = 2 and a modified decoder, this difference varies in the range from 0.002 to 
0.01depending on the LDPC code. 

Both decoders are sensitive to the number of cycles in Tanner graph corresponding to the LDPC code check 
matrix. The greater the ratio of the number of cycles to the total number of elements in the matrix, the worse any BF 
decoder corrects errors. During the experiments, it was interesting to find out whether it is possible to increase the 
number of cycles in the matrix so that the modified decoder will show worse results compared to the BF decoder. 
Experimentally, the matrix H, containing 41 cycles of length 6 was found. The results of the study on the error- 
correcting capability of decoders for this matrix are shown in Fig. 5. Note, however, that the matrix H, contains even 
more cycles of length 6, namely, 42. The fundamental difference between the matrices H, and H, is in the density of 
units: 

— in H, — 60 unit elements per 300 matrix elements, 
— in H, — 84 units per 588 matrix elements. 

Recall that the feature of LDPC codes is the sparse structure of the check matrix, so H, 1s more typical for 
LDPC codes. 

Discussion and Conclusions. The paper considers a bit-flipping decoder for binary LDPC codes. 


Recommendations on the selection of such input parameters of the decoder as the threshold and the number of iterations 
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of the algorithm are given. A lemma on the maximum value of the decoder threshold is formulated and proved. A 
modification of the BF decoder of binary LDPC codes has been developed, in which it is proposed to set the threshold 
dynamically during the execution of the algorithm depending on the resulting syndrome. For the original and modified 
decoders, upper estimates of the number of operations are found. These estimates show that the modification 
complicates the decoder only slightly. The conducted simulation experiments demonstrate better error-correcting 
capability of the modified decoder in relation to the original one. The experiments also showed the dependence of the 
decoding quality on the degree of matrix sparsity and the number of cycles of length 6 in the Tanner graph 
corresponding to the check matrix of the LDPC code. Thus, the problem of constructing check matrices with a small 


number of short cycles arises, which is the subject of further research. 
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